• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The present invention relates to a system for obtaining useful data for the analysis of body morphometry and associated method that determines body morphometry, in infants or non-infants, from 3D models automatically, non-invasively, quickly and under cost. In addition, the system and method obtain 3D measurement and modeling of the patient, infant or not, in a conscious state, not being influenced by movement. (Machine-translation by Google Translate, not legally binding)
    公开号:ES2725927A1
    申请号:ES201930355
    申请日:2019-04-17
    公开日:2019-09-30
    发明作者:García José Luis Lerma；García Inés Barbero；Lloret Pablo Miranda；Pons Silvia Blanco；Ruiz Berta Carrión
    申请人:Fundacion Para La Investigacion Del Hospital Univ La Fe de la Comunidad Valenciana；Universidad Politecnica de Valencia；
    IPC主号:
    专利说明:

    [0001]
    [0002] OBJECT OF THE INVENTION
    [0003]
    [0004] The present invention relates to a system for obtaining useful data for the analysis of body morphometry and associated method that allows the analysis of body morphometry, since it is a photogrammetric method specifically developed to offer reliable 3D results regardless of movement or patient posture, non-invasively, such as infants.
    [0005]
    [0006] The object of the present invention is a system for obtaining useful data for the analysis of body morphometry and associated method that allows obtaining 3D metric models from photogrammetric solutions to determine body morphometry automatically, non-invasively, quickly. And at a low cost. In addition, the system and method obtain the patient's data (infant or not) in a conscious state, as they are not influenced by movement.
    [0007]
    [0008] BACKGROUND OF THE INVENTION
    [0009]
    [0010] Body deformations are a problem that affects a large number of patients. Among them, cranial deformation is a problem that affects a high percentage of infants. There are different causes, from the positional, due to premature suture of the cranial fontanelles. The consequences may vary and are purely aesthetic in the mildest cases, but may pose a risk of elevated intracranial pressure in the most severe cases. The deformation is usually treated with physiotherapy, repositioning, prosthetic helmets and, in some cases, surgery. The diagnosis during the first months of life is a great advantage for the correction of the deformity.
    [0011]
    [0012] Cranial deformation is usually assessed by medical personnel using methodologies such as the combination of tape measure and caliper or radiological tests. such as Computed Axial Tomography (CT) and Nuclear Magnetic Resonance Imaging (NMR) (Siegenthaler, 2015). The evaluation with both tape measure and caliber is fast and low cost, but the information obtained is very limited. In severe cases, the alternative is radiological tests, which result in a detailed 3D model that allows the deformity to be analyzed accurately. The disadvantage of radiological tests is their high cost and the fact that they are highly invasive by requiring the sedation of infants and involve radiation.
    [0013]
    [0014] There are non-invasive deformity analysis methodologies (Spitzer et al., 2011; Cho et al., 2018), although the level of detail is low as they are 2D solutions only, so they do not correctly represent any type of deformation. In addition, in some cases they require a high time to record all measurements.
    [0015]
    [0016] There are also tools that use images, usually composed of combinations of scanners (Nahles et al., 2018) and cameras (Skolnick et al., 2015; Meulstee et al., 2017). Although they represent the deformity well, they are high-cost solutions that require an investment for their implementation in clinical practice and, for this reason, their use is not widespread. In addition, many of these solutions do not work with patients on the move which makes it impossible to use in infants.
    [0017]
    [0018] 3D head modeling solutions are also available using a single camera, but all of them studied are based on the digitalization of the face, reconstructing the cranial surface from information of different individuals contained in databases. These solutions completely lack metric quality.
    [0019]
    [0020] The applicant is unaware of the existence of useful data collection systems for the analysis of body morphometry and associated methods that allow the determination of body morphometry (in infants or not) automatically, non-invasively and with great precision and speed.
    [0021]
    [0022] DESCRIPTION OF THE INVENTION
    [0023]
    [0024] The present invention relates to a system for obtaining useful data for the analysis of body morphometry comprising:
    [0025] - an encoded mesh configured to be adjusted to a body surface; - a set of targets arranged in the coded mesh;
    [0026] - at least one image sensor configured to register the set of targets arranged in the mesh;
    [0027] - means for processing the set of images configured to generate a three-dimensional model of the body surface from the set of targets arranged in the coded mesh and configured to be registered by the at least one image sensor; Y
    [0028] - means of visualization of the three-dimensional model of the body surface.
    [0029]
    [0030] Preferably, the at least one image sensor configured to register the set of targets arranged in the coded mesh and the processing means are integrated in a smartphone ( smartphone).
    [0031]
    [0032] The processing means integrated in the smartphone can be an application integrated in the smartphone that evaluates the quality of the images and selects them in real time, saving the information in a specific format. In addition, it guides the user, ensuring that the necessary data are obtained to obtain the 3D metric model from the photogrammetric solution to determine the body morphometry automatically.
    [0033]
    [0034] Preferably, the processing means are integrated in a device other than the device where the at least one image sensor is integrated.
    [0035]
    [0036] Preferably, the system further comprises additional targets (optionally not more than three) configured to be fixed to the mesh coded at certain points and which will allow the reference system to be fixed;
    [0037]
    [0038] Preferably, the at least one image sensor configured to register the set of targets arranged in the encoded mesh is selected from at least one of a camera, a smartphone or a tablet.
    [0039]
    [0040] Preferably, the mesh is a chaplain configured to be adjusted to a cranial surface
    [0041]
    [0042] The invention also relates to a method of obtaining useful data for the analysis of body morphology carried out with the system described above, where the method comprises:
    [0043] - a step of adjusting the coded mesh to the body surface;
    [0044] - a step of placing a set of targets on the coded mesh;
    [0045] - a step of registering the set of targets arranged in the coded mesh by at least one image sensor;
    [0046] - a stage of processing the set of images by means of the processing means in which a three-dimensional model of the body surface is generated from the set of targets recorded in the previous stage; and - a stage of visualization of the three-dimensional model of the body surface by means of visualization.
    [0047]
    [0048] In the processing stage the selection of the images and the obtaining of the useful data of these in real time during the taking is carried out.
    [0049]
    [0050] Optionally, the method further comprises a stage of detachably placing the first target, the second target and the third target in the coded mesh between the stage of adjustment of the mesh to the body surface and the registration stage of the set of targets arranged in the coded mesh by means of the at least one image sensor, to define a coordinate system.
    [0051]
    [0052] Optionally, the method further comprises a step of checking the registration stage of the set of targets arranged in the coded mesh, where the number of targets arranged in the coded mesh that have been recorded from among the set of checks is carried out. targets, to determine if the number of registered targets is sufficient to validate the registration stage based on parameters such as calibration and / or external orientation of the images.
    [0053]
    [0054] Optionally, the processing stage of the set of images by means of the processing means in which a three-dimensional model of the body surface is generated from the set of detected targets comprises a sub-stage of generation of a cloud of points corresponding to the set of targets detected.
    [0055]
    [0056] BRIEF DESCRIPTION OF THE DRAWINGS
    [0057]
    [0058] Figures 1c, 1b and 1c show paths in perspective view of the chaplain configured to be adjusted to the body surface to be measured automatically by the system and method of obtaining useful data for the analysis of body morphometry, in 3D of the present invention
    [0059]
    [0060] Figure 2 shows an application interface of the smartphone or smartphone where the processing means of the system and method of obtaining useful data for the analysis of the body morphometry of the present invention are applied, applied to the case of a cranial deformation .
    [0061]
    [0062] Figures 3a and 3c show a side and top view respectively of the point cloud corresponding to the set of detected targets, derived from the generation sub-stage of the point cloud.
    [0063]
    [0064] Figures 3b and 3d show a side and top view respectively of the three-dimensional model of the head surface generated from the set of detected targets, corresponding to the point clouds of Figures 3a and 3c respectively.
    [0065]
    [0066] Figure 4 shows another application interface of the smartphone or smartphone once the three-dimensional model of the head surface of Figure 3d is generated.
    [0067]
    [0068] PREFERRED EMBODIMENT OF THE INVENTION
    [0069]
    [0070] Next, the system and method of obtaining useful data for the analysis of the body morphometry of the present invention will be described in detail.
    [0071]
    [0072] The system for obtaining useful data for the analysis of body morphometry includes:
    [0073] - a cope chapel or mesh (1) configured to be adjusted to a body surface (2);
    [0074] - a set of targets (4) arranged in the coded chapel or mesh (1) - at least one image sensor configured to register the set of targets (4) arranged in the coded chaplain or mesh (1);
    [0075] - means of processing integrated in the same device of the camera that allow the selection of the images and the obtaining of useful information of these, besides serving as a guide for the user; Y
    [0076] - means of processing the set of images (3) configured to generate a three-dimensional model (5) of the body surface (2) from the set of targets (4) arranged in the body capelin or mesh (1) and configured to be registered by the at least one image sensor; and - visualization means (6) of the three-dimensional model (5) of the body surface (2).
    [0077]
    [0078] The set of targets (4) arranged in the coded chapel or mesh (1) configured to be detected by the at least one image sensor comprises a first target (41), a second target (42) and a third target (43) configured to be detachably disposed in the cope or mesh (1) coded, where preferably, the first target (41), the second target (42) and the third target (43) comprise means for joining the first target ( 41), the second target (42) and the third target (43) to the chapeline or coded mesh (1), where these joining means are preferably an adhesive.
    [0079]
    [0080] The chaplain or mesh (1) encoded with the set of targets (4) arranged therein (1) allows to obtain three-dimensional models (5) of body surfaces, for example, infant heads (2) which allows to determine the morphometry of The measured area. The advantage of this system is that it allows automatic obtaining of three-dimensional models (5) in a non-invasive, fast and low cost way. In addition, the tool works with the patient (nursing or not) conscious, not being influenced by movement. Therefore, the use of anesthesia is not necessary.
    [0081]
    [0082] The system may be used by medical personnel without knowledge of photogrammetry. For this, the system comprises an application (8) that guides medical personnel during data collection.
    [0083] Regarding the method of obtaining useful data to determine the body morphometry, carried out with the system described above and applied to the case of the head, said method comprises:
    [0084] - a step of adjusting the chaplain or mesh (1) encoded to the body surface (2);
    [0085] - a step of placing a set of targets (4) in the cope or mesh (1) encoded;
    [0086] - a step of registering the set of targets (4) arranged in the chapel or coded mesh (1) by at least one image sensor;
    [0087] - a processing stage of the set of images (3) by means of the processing means in which a three-dimensional model (5) of the body surface (2) is generated from the set of targets (4) recorded in the previous stage; Y
    [0088] - a stage of visualization of the three-dimensional model (5) of the body surface (2) by means of the visualization means (6).
    [0089]
    [0090] The processing stage of the set of images (3) by means of the processing means in which a three-dimensional model (5) of the cranial surface (1) is generated from the set of targets (4) detected, comprises a generation sub-stage of a cloud of points (7) corresponding to the set of targets (4) detected.
    [0091]
    [0092] The processing stage of the image set (3) by means of the processing means is carried out by means of a processing algorithm integrated in the image taking device (mobile phone application, for example) that evaluates the quality of the images and select them in real time.
    [0093]
    [0094] EXAMPLE
    [0095]
    [0096] In detail, first of all, the medical staff must place the chaplain.
    [0097] It will be important to respect the positioning position, at least, approximately. Subsequently, the medical user will detachably place the first target (41), the second target (42) and the third target (43) at the points identified as right preauricular, preauricular left (in front of the drink in both cases) and glabella, respectively. This will allow to define a common coordinate system for all the generated models. Once the previous steps have been performed, the device's camera will be started and the interface will be similar to recording a video. In each frame will be displayed those targets that are being detected, as shown in Figure 2, which in this example are highlighted with respect to the rest. Also shown in the upper part, the percentage of targets detected, as well as in the lower part, the correctly registered areas of those that are not. In this way a non-expert user can easily check whether the distance to the patient, focus, etc. They are appropriate. The interface also shows the areas of the head that have already been properly registered and those that still require more images.
    [0098]
    [0099] For each frame, the application detects the targets. It is checked if the number of targets detected is sufficient to resolve the calibration and external orientation of the images; It also evaluates whether the image provides new information or, on the contrary, repeats already registered information. If the frame is selected, the detected targets and their coordinates are recorded in a file. No images are saved, so the required storage is very low. In addition, the data can be completely anonymized by increasing the security and privacy of highly sensitive data. In the same file the basic parameters of the camera are also stored, which will allow its calibration.
    [0100]
    [0101] Once the entire head has been registered with a minimum number of images, the 3D model can be obtained from the generated coordinate file. The coordinates of the targets are processed as homologous points. An algorithm has been created that encodes the numbering of the 3D point cloud, following the numbering of the coded targets.
    [0102]
    [0103] The software for creating the application is based on the Tapas and AperiCloud tools, belonging to the MicMac software. Subsequently, the point cloud is scaled using the known size of the targets and the mesh is created using Poisson Reconstruction and MeshLab. Finally, the model is scaled using the known size of the targets.
    [0104] The mesh created will be used to obtain the deformation parameters and can be compared with data stored in previous captures. The model and the data obtained can also be displayed in a web viewer.
    [0105]
    [0106] The present system and method are based on a photogrammetric solution that has been validated by comparison with caliber and measuring tape measurements (Barbero-García et al., 2017), models obtained using reflex cameras (Lerma et al., 2018) and tests radiological (Barbero-García et al., 2019).
    权利要求:
    Claims (12)
    [1]
    1. - System for obtaining useful data for the analysis of body morphometry characterized in that it comprises:
    - a coded mesh (1) configured to be adjusted to a body surface (2);
    - a set of targets (4) arranged in the coded mesh (1);
    - at least one image sensor configured to register the set of targets (4) arranged in the encoded mesh (1);
    - means for processing the set of images (3) configured to generate a three-dimensional model (5) of the body surface (2) from the set of targets (4) arranged in the coded mesh (1) and configured to be registered by the at least one image sensor; Y
    - display means (6) of the three-dimensional model (5) of the body surface (2).
    [2]
    2. - System for obtaining useful data for the analysis of body morphometry according to claim 1 characterized in that the at least one image sensor configured to register the set of targets (4) arranged in the coded mesh (1) and the means of Processing are integrated into a smartphone or smartphone.
    [3]
    3. - System for obtaining useful data for the analysis of body morphometry according to claim 2, characterized in that the processing means are integrated in an application (8) of the smartphone or smartphone.
    [4]
    4. - System for obtaining useful data for the analysis of body morphometry according to any of the preceding claims characterized in that the set of targets (4) arranged in the coded mesh (1) configured to be detected by the at least one sensor of Image comprises a first target (41), a second target (42) and a third target (43) configured to be detachably disposed in the encoded mesh (1).
    [5]
    5. - System for obtaining useful data for the analysis of body morphometry according to claim 4 characterized in that the first target (41), the second target (42), and the third (43) comprise means for joining the first target (41), the second target (42) and the third target (43) to the coded mesh (1).
    [6]
    6. - System for obtaining useful data for the analysis of body morphometry according to any of the preceding claims, characterized in that the coded mesh (1) is a chapelin configured to be adjusted to a cranial surface (2).
    [7]
    7. - Method of obtaining useful data for the analysis of body morphometry carried out with the system of any of the preceding claims, characterized in that said method comprises:
    - a step of adjusting the mesh (1) encoded to the body surface (2);
    - a step of placing a set of targets (4) on the coded mesh (1);
    - a step of registering the set of targets (4) arranged in the mesh (1) encoded by the at least one image sensor;
    - a processing stage of the set of images (3) by means of the processing means in which a three-dimensional model (5) of the body surface (2) is generated from the set of targets (4) recorded in the previous stage; Y
    - a stage of visualization of the three-dimensional model (5) of the body surface (2) by means of the visualization means (6).
    [8]
    8. - Method of obtaining useful data for the analysis of body morphometry according to claim 7, characterized in that it further comprises a stage of detachably placing the first target (41), the second target (42) and the third target (43 ) in the mesh (1) encoded between the adjustment stage of the mesh (1) encoded to the body surface (2) and the registration stage of the set of targets (4) arranged in the mesh (1) encoded by the at minus an image sensor, to define a coordinate system.
    [9]
    9. - Method of obtaining useful data for the analysis of body morphometry according to any of claims 7 or 8, characterized in that it also comprises a step of checking the stage of registration of the set of targets (4) arranged in the mesh (1 ) coded where the verification of the number of targets (4) arranged in the coded mesh (1) that have been recorded from between the set of targets (4), to detect whether the number of registered targets (4) is sufficient to validate the registration cover based on parameters such as the ca lib ration and / or external orientation of the images.
    [10]
    10.- Method of obtaining useful data for the analysis of the body model according to which of the indications 7 to 9 characterized in that the processing stage of the set of images (3) By means of the processing means in which a three-dimensional model of the body surface (2) is generated from the set of targets (4) registered as a sub-stage of generation of a cloud of points (7) corresponding to the set of targets (4) detected.
    [11]
    11. - Method of obtaining useful data for the analysis of the body model according to which of the indications 7 to 10 characterized in that the adjustment cap of the sample (1) cod ified to the body surface (2) requires the inclusion of additional targets to the coded (1) codified).
    [12]
    12. - Method of obtaining useful data for the analysis of the body geometry according to re iv indication 10 characterized in that the processing stage of the set of images (3) comprises a sub-stage of assis- tance to the user during data collection, prior to the generation of the trid im ensiona model
    类似技术:
    公开号 | 公开日 | 专利标题
    Camison et al.2018|Validation of the Vectra H1 portable three-dimensional photogrammetry system for facial imaging
    US8463360B2|2013-06-11|Surgery support device, surgery support method, and computer readable recording medium storing surgery support program
    US8223915B2|2012-07-17|Method and apparatus for radiographic imaging
    US9241657B2|2016-01-26|Medical image registration using a rigid inner body surface
    EP3195823B1|2022-01-12|Optical tracking system
    US20180028108A1|2018-02-01|Digital wound assessment device and method
    EP3259705A1|2017-12-27|System and method for positional registration of medical image data
    Bingham et al.2016|Axial globe position measurement: a prospective multi-center study by the international thyroid eye disease society
    CN104274196A|2015-01-14|Computed tomography device
    ES2251182T3|2006-04-16|REPRODUCIBLE CAPTION OF THE SITUATION OR POSITION OF DEFORMABLE BODIES.
    KR101432651B1|2014-08-25|Infrared thermography detection method
    ES2725927A1|2019-09-30|SYSTEM OF OBTAINING USEFUL DATA FOR THE ANALYSIS OF BODY MORPHOMETRY AND ASSOCIATED METHOD |
    Mummolo et al.2016|The 3D tele motion tracking for the orthodontic facial analysis
    Malian et al.2004|Medphos: a new photogrammetric system for medical measurement
    US20150265228A1|2015-09-24|Method for Registering a Near-Infared Spectroscopy Map and an Anatomical Image Data Record and X-Ray Device
    US6810280B2|2004-10-26|Method and apparatus for detecting the three-dimensional position of an examination instrument inserted into a body region
    JP5140810B2|2013-02-13|Tomographic image overlay display method and computer program for displaying tomographic images superimposed
    KR20160057024A|2016-05-23|Markerless 3D Object Tracking Apparatus and Method therefor
    Kutilek et al.2009|Non-contact method for measurement of head posture by two cameras and calibration means
    Kutilek et al.2010|Comparison of methods of measurement of head position in neurological practice
    Moshkelgosha et al.2014|Software designation to assess the proximity of different facial anatomic landmarks to midlines of the mouth and face
    TWI573565B|2017-03-11|Cone - type beam tomography equipment and its positioning method
    Rahman et al.2013|Validity of close range photogrammetry technique on craniofacial soft tissue measurement
    JP2022505955A|2022-01-14|Spatial alignment method for imaging equipment
    KR20210015433A|2021-02-10|Apparatus and method for length measurement of clavicle ct image
    同族专利:
    公开号 | 公开日
    ES2725927B2|2020-11-26|
    CA3138004A1|2020-10-22|
    AU2020259156A1|2021-11-18|
    EP3958215A1|2022-02-23|
    WO2020212632A1|2020-10-22|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    法律状态:
    2019-09-30| BA2A| Patent application published|Ref document number: 2725927 Country of ref document: ES Kind code of ref document: A1 Effective date: 20190930 |
    2020-11-26| FG2A| Definitive protection|Ref document number: 2725927 Country of ref document: ES Kind code of ref document: B2 Effective date: 20201126 |
    优先权:
    申请号 | 申请日 | 专利标题
    ES201930355A|ES2725927B2|2019-04-17|2019-04-17|SYSTEM FOR OBTAINING USEFUL DATA FOR ANALYSIS OF BODY MORPHOMETRY AND ASSOCIATED METHOD|ES201930355A| ES2725927B2|2019-04-17|2019-04-17|SYSTEM FOR OBTAINING USEFUL DATA FOR ANALYSIS OF BODY MORPHOMETRY AND ASSOCIATED METHOD|
    EP20791392.2A| EP3958215A1|2019-04-17|2020-03-18|System for the obtaining of data of use for body morphometric analysis and associated method|
    CA3138004A| CA3138004A1|2019-04-17|2020-03-18|System for obtaining useful data for analysis of body morphometry and associated method|
    AU2020259156A| AU2020259156A1|2019-04-17|2020-03-18|System for obtaining useful data for analysis of body morphometry and associated method|
    PCT/ES2020/070191| WO2020212632A1|2019-04-17|2020-03-18|System for the obtaining of data of use for body morphometric analysis and associated method|
    [返回顶部]